Enhancing complex-network synchronization 
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Heterogeneity in tlie degree (connectivity) distribution has been shown to suppress synchronization in net- 
works of symmetrically coupled oscillators with uniform coupling strength (unweighted coupling). Here we 
uncover a condition for enhanced synchronization in directed networks with weighted coupling. We show that, 
in the optimum regime, synchronizability is solely determined by the average degree and does not depend on 
the system size and the details of the degree distribution. In scale-free networks, where the average degree may 
increase with heterogeneity, synchronizability is drastically enhanced and may become positively correlated 
with heterogeneity, while the overall cost involved in the network coupling is significantly reduced as compared 
to the case of unweighted coupling. 
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Networks of dynamical elements serve as natural models 
for a variety of systems, with examples ranging from cell 
biology to epidemiology to the Internet [T]. Many of these 
complex networks display common structural features, such 
as the small-world |2] and scale-free properties |3]. Small- 
world networks (SWNs) exhibit short average distance be- 
tween nodes and high clustering 1 2], while scale-free networks 
(SFNs) are characterized by an algebraic, highly heteroge- 
neous distribution of degrees (number of links per node) [3^. 
The interplay between structure and dynamics has attracted a 
great deal of attention, especially in connection with the prob- 
lem of synchronization of coupled oscillators [4j^^ 3]. The 
ability of a network to synchronize is generally enhanced in 
both SWNs and random SFNs as compared to regular lattices 
1 4, 5, a 013]. This enhancement was previously believed to 
be due to the decrease of the average distance between os- 
cillators. Recently, it was shown that random networks with 
strong heterogeneity in the degree distribution, such as SFNs, 
are much more difficult to synchronize than random homoge- 
neous networks [7], even though the former display smaller 
average path length iToll. This suggests that, although struc- 
sfll'l. 



the scale-free property may be dy- 
Here we present a solution to this 



turally advantageous | 
namically detrimental, 
problem. 

A basic assumption of previous work is that the oscilla- 
tors are coupled symmetrically and with the same coupling 
strength. Under the assumption of symmetric coupling, the 
maximum synchronizability is indeed achieved when the cou- 
pling strength is uniform 1 12]. But to get a better synchroniz- 
ability the couplings are not necessarily symmetrical. Many 
realistic networks are actually directed ] 1] and weighted fl31. 
In particular, the communication capacity of a node is likely 
to saturate when the degree becomes large. 

In this Letter, we study the impact that asymmetry and satu- 
ration of connection strength have on the synchronization dy- 
namics on complex networks. As a prime example, we con- 
sider complete synchronization of linearly coupled identical 



oscillators, namely 
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Gijh{xj), z = 1, . . .TV, 
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where / = f{x) describes the dynamics of each individual 
oscillator, h = h{x) is the output function, G = [Gij) is the 
coupling matrix, and a is the overall coupling strength. In the 
case of symmetrically coupled oscillators with uniform cou- 
pling strength, G is the usual (symmetric) Laplacian matrix 
L — [Lij) ]14]. For Gij = Lij, heterogeneity in the de- 
gree distribution suppresses synchronization [7]. In order to 
enhance the synchronizability of heterogeneous networks, we 
propose to scale the coupling strength by the degrees of the 
nodes. For specificity, we consider 



^ij — l^ij / f^ 
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where ki is the degree of node i and /3 is a tunable parameter 
The underlying network associated with the Laplacian matrix 
L is undirected and unweighted, but with the introduction of 
the weights in eq. (|2ji, the network of couplings becomes not 
only weighted but also directed because the resulting matrix G 
is in general asymmetric. We say that the network or coupling 
is weighted when (3 y^ and unweighted when /? = 0. 

The variational equations governing the linear stability of 
a synchronized state {xi{t) = s{t),yi} can be diagonalized 
into N blocks of the form r) = [Df{s) — aDh{s)] rj, where 
a = (j\i, and Xi are the eigenvalues of the coupling matrix G, 
ordered as = Ai < A2 • • • < Xn (see below). The largest 
Lyapunov exponent A(a) of this equation can be regarded as 
a master stability function, which determines the linear stabil- 
ity of the synchronized state Il5|]: the synchronized state is 
stable if A(o'Ai) < for i = 2, . . . N. (The eigenvalue Ai 
corresponds to a mode parallel to the synchronization mani- 
fold.) For many widely studied oscillatory systems ]6, 15], the 
master stability function A(q;) is negative in a finite interval 
(«!, 0:2). Therefore, the network is synchronizable for some 
a when the eigenratio R = Xn /X2 satisfies R < a^jcti. The 
ratio oi2loi\ depends only on the dynamics (/, h, and s), while 
the eigenratio R depends only on the coupling matrix G. The 
problem of synchronization is then reduced to the analysis of 



eigenvalues of the coupling matrix f6\ : the smaller the eigen- 
ratio R the more synchronizable the network. 

Here we show that, as a function of (3, the eigenratio R has 
a global minimum at f3 — 1. In large networks with some 
degree of randomness, the eigenratio at f3 — 1 is primarily 
determined by the average degree k of the network and does 
not depend on the degree distribution and system size, in sharp 
contrast with the case of unweighted coupling (/? ~ 0), where 
synchronization is strongly suppressed as the heterogeneity or 
number of oscillators is increased. Furthermore, we show that 
the total cost involved in the network coupling is significantly 
reduced for (3=1 when compared to /3 = 0. As a result, 
structural robustness pill| and improved synchronizability can 
coexist in scale-free and other heterogeneous networks. 

In matrix notation, eq. Q can be written as G = 
D~^L, where D = diagjfci, k2, . . . k^} is the diagonal ma- 
trix of degrees. From the identity det{D^^L — A/) = 
det(I?"'^/2iD~'^/2 - XI), valid for any A, we have that the 
spectrum of eigenvalues of matrix G is equal to the spectrum 
of a symmetric matrix defined as H = D~^^^LD~^^^. As a 
result, all the eigenvalues of matrix G are real. Moreover, be- 
cause H is positive semidefinite, all the eigenvalues are non- 
negative and, because the rows of G have zero sum, the small- 
est eigenvalue Ai is always zero, as assumed above. If the 
network is connected, A2 > for any finite^. For spectral 
properties of unweighted networks, see refs. rio. 17. 18l ll9ll . 

We first examine the dependence on (3. Physically, we ex- 
pect the synchronizability to be strongly influenced by the 
strength of the input coupling at each oscillator When (3 < 1, 
oscillators with larger degree are more strongly coupled than 
oscillators with smaller degree. When /3 > 1, the opposite 
happens. Because {ai, 02) is finite, for the network to syn- 
chronize, the overall coupling strength cr must be large enough 
to synchronize the least coupled oscillators and small enough 
to synchronize the most coupled ones (i.e., the synchronizabil- 
ity of these oscillators is expected to be primarily determined 
by the modes associated with the eigenvalues A2 and Xn, re- 
spectively). Therefore, for both f3 < 1 and (3 > 1, some os- 
cillators are more strongly coupled than others, and the ability 
of the network to synchronize is limited by those oscillators 
that are least and most strongly coupled. We then expect the 
network to achieve maximum synchronizability at /3 = 1. In 
fig. [2 we show the numerical verification of this hypothesis 
on three different models of SFNs, defined as follows: 

(A) Random SFNs |201 — Each node is assigned to have a 

number ki of "half-links" according to the probability 
distribution P{k) ~ k~'', where 7 is a scaling expo- 
nent and k > kmin ■ The network is generated by ran- 
domly connecting these half-links to form links, pro- 
hibiting self- and repeated links. In the limit 7 = 00, all 
the nodes have the same degree k = kmin- 

(B) Networks with expected scale-free sequence 1 18] — The 

network is generated from a sequence ki,k2, . . .k^, 
where max^ kf < J^i^'i' so that links are indepen- 
dently assigned to each pair of nodes {i,j) with prob- 
ability Py = kikj / 'Y^^ki. When the expected degrees 
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FIG. 1: Eigenratio i? as a function of /?: (a) random SFNs with 
7 = 3 (•), 7 = 5 (■), 7 = 7 (i), and 7 = 00 (solid line), for 
kmin = 10; (b) networks with expected scale-free sequence (♦) for 
7 = 3 and kmin = 10, and growing SFNs (•) for 7 = 3 and 
m = 10. Each curve is the result of an average over 50 realizations 
for N = 1024. 



have a network with expected scale-free sequence. 
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(C) Growing SFNs 112 IB — We start with a fully connected 
network with m nodes and at each time step a new node 
with m links is added to the network. Each new link is 
connected to a node i in the network with probability 
n,; ^ (1 — p)ki + p, where < p < 1 is a tunable 
parameter. For large degrees, the scaling exponent of 
the resulting network is 7 = 3 + p[rn{l — p)]^^. For 
p = 0, we recover the Barabasi-Albert model |3||. 

As shown in fig. [2 a pronounced minimum for the eigenra- 
tio i? at /3 = 1 is observed in each case. A similar minimum 
for R at (3 = 1 is also observed in many other models of 
complex networks, including the Watts -Strogatz model fz] of 
SWNs. The only exception is the class of homogeneous net- 
works, where all the nodes have the same degree k. In this 
case, the weights can be factored out and R is independent of 
/?, as shown in fig. [Ha) for random homogeneous networks 
with fc = 10 (solid line). 

In heterogeneous networks, the synchronizability is signif- 
icantly enhanced when the coupling is suitably weighted, as 
shown in fig.|2lfor SFNs with f3 = 1. In SFNs, the heterogene- 
ity (variance) of the degree distribution increases as the scal- 
ing exponent 7 is reduced. When the coupling is unweighted 
(/3 = 0), the eigenratio R increases with heterogeneity, but the 
eigenratio does not increase and may even decrease with het- 
erogeneity when the coupling is weighted {(3 = 1), as shown 
in figs.|2a-c). The enhancement is particularly large for small 
7, where the networks are highly heterogeneous (note the log- 
arithmic scale in fig. |3. The networks become more homo- 
geneous as 7 is increased. In the limit 7 = cxi, random SFNs 
converge to random homogeneous networks with the same de- 
gree kmin for all nodes [fig. |2ja)], while networks with ex- 
pected scale-free sequence converge to Erdos-Renyi random 
networks I22ll . which have links assigned with the same prob- 
ability between each pair of nodes [fig. |2jb)]. As one can 
see from fig.|3b), the synchronizability is strongly enhanced 
even in the relatively homogeneous Erdos-Renyi model; such 
an enhancement occurs also in growing networks [fig.EJc)]. 
Surprisingly, for (3=1, the eigenratio R turns out to be well 
approximated by the corresponding eigenratio of random ho- 
mogeneous networks with the same average degree [figs.|2ja- 
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FIG. 2: (a-c) Eigenratio i? as a function of the scaling exponent 7: 
(a) random SFNs, (b) networks with expected scale-free sequence, 
and (c) growing SFNs, f or /3 = 1 (•) and /? = (o). The other pa- 
rameters are the same as in fig.Q Also plotted are the bound of eq. 
J4j (solid line) and Rat'y — 00 for (3—1 (dashed line) and /3 = 
(dot-dashed line). The symbols correspond to random homoge- 
neous networks with the same average degree of the corresponding 
SFNs, as indicated in the figure, (d-f) 7? as a function of the system 
size for 7 = 3 and the models in (a-c), respectively. The legend is 
the same as in (a-c). 



c)]. Moreover, the eigenratio R appears to be independent of 
the system size for /3 = 1 in large SFNs, in contrast to the un- 
weighted case, where R increases strongly with the number 
of oscillators [figs.|2jd-f)]. 

We now present an approximation for the eigenratio R that 
supports and extends our numerical observations. In what fol- 
lows we focus on the case /5 = 1. Based on results of ref. 1 18] 
for random networks with arbitrary expected degrees, which 
includes important SFNs, we get 



max{l - A2, Aat - 1} = [1 + 0(1)] 



Vk' 



(3) 



where k is the average expected degree. This result is rig- 
orous for networks with a given expected degree sequence 
ki,k2, ■ ■ ■ kN, as defined in the model (B) above. The as- 
sumption for this result is k„iin = mini ^j to be large as com- 
pared to V A; In N, but our numerical simulations suggest that 
this assumption can be released considerably because eq. (|3} 

is observed to hold for kmin as small as 2\/k. Having re- 
leased this assumption, from eq. ^ we have the following 
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FIG. 3: Normalized cost as a function of the scaling exponent 7 for 
random SFNs with /3 = 1 (•) and /? = (o), and for random ho- 
mogeneous networks with the same average degree (0). The solid 
line corresponds to 7 = (x>. Inset: Ratio r = Co/Ci of the cost for 
/3 = (Co) and /3 = 1 (Ci) as a function of 7. The other parameters 
are the same as in fig.Q 



explicit upper bound for the eigenratio in large networks: 



R< ^. (4) 



1-2 

Therefore, the eigenratio is bounded by a function of the av- 
erage degree, which does not depend on the system size, in 
agreement with the results in figs. |2jd-f). Moreover, we ex- 
pect R to approach the upper bound in eq. ^ because the 
semicircle law holds and the spectrum is symmetric around 1 

for kmin ^ V fc in the thermodynamical limit 1 18, 19]. This 
prediction is confirmed numerically under much weaker con- 
ditions, as shown in figs.|2ja-c), where one can see a remark- 
able agreement between the approximate and exact values of 
R for all three models of SFNs. Since the bound in eq. 
does not depend on the degree distribution, this result also 
explains the agreement between the eigenratio for weighted 
SFNs [figs. 13 a-c), •] and the eigenratio for random homo- 
geneous networks with the same average degree [figs.|3a-c), 
0]. A similar agreement is observed in many other complex 
networks. 

It is also important to study the influence of degree cor- 
relation and clustering on the synchronizability of the net- 
works. Our extensive numerical computation on the models 
of refs. 123I I24I1 shows that the eigenratio R generally in- 
creases with increasing clustering and assortativity in corre- 
lated networks. However, a pronounced global minimum for 
i? as a function of /3 is always observed at /3 = 1. In addition, 
weighted networks at /? = 1 are much more insensitive to the 
effects of correlation than their unweighted counterparts. The 
same tendency is observed in the growing model with aging of 
ref. 1I25I1 . which has nontrivial clustering and correlation. All 
together, these suggest that our results are quite robust and 
expected to hold on real-world networks as well. 

Now we address the important problem of the cost involved 
in the connections of the network. The cost C is naturally 
defined as the total strength of all the directed links, i.e.. 



C 



J2ih ' where cr„ 



ai/X2 is the mini- 



mum overall coupling strength for the network to synchronize. 



Strikingly, in heterogeneous networks, the cost for /? = 1 is 
considerably smaller than the cost for /? = [fig-OJ. The 
cost for /3 = 1 is well approximated by the cost for ran- 
dom homogeneous networks with the same average degree 
k, as indicated in fig. |3l In this case, from above we have 
C/{Nai) = I/A2 ~ 1/(1 - 2/Vk), and the cost is reduced 
as k is increased, approaching C/{Nai) — 1 for large glob- 
ally coupled networks. Therefore, cost reduction is another 
important advantage of the weighted coupling. 

In summary, we have introduced a model of directed net- 
works with weighted coupling which, we believe, can serve 
as a paradigm to address various issues regarding dynamics 
on complex networks. Within this model, we have shown that 
suitably weighted networks display significantly improved 
synchronizability and lower cost. An important implication of 



our findings is that weighted SFNs can exhibit enhanced com- 
plete synchronization. We expect our results to be relevant 
for both network design and the understanding of dynamics in 
natural systems, such as synchronization in neural networks 
11261 and synchronization of epidemic outbreaks in networks 
of cities lIZTIl . where weighted couplings are expected to play 
an important role ll28ll . 
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